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Disclaimer: Lorr 
aine is an 

renegade 

superhero. She 
receives no 

financial 

contribution from 

Pa wan Gupta ^ e MODIS 

(USRA) aerosol group, 
and does not in 
any way 
"influence the 
government on 
this particular 
matter on behalf 
of UMBC". 

Telling Rob what to do, 
on a personal level, is 
perfectly legal. That's 

just female-male 
communication. 


Rob Levy 
(GSFC) 



When we last saw our 
motley gang of heroes.. 


(Scenes from Season II) 
AeroCenter update: May 2012 


.. They were promising "final" delivery 
of Collection 6 algorithms 

(imagine camera pans into each office) 

Rob was fussing with gas correction 

Leigh was fixing the cloud mask 

Shana was ordering that Version V6.0.11 
was the final version 

Rich was evaluating DeepBlue/DarkTarget merge 
Lorraine was at UMBC, starting AirPhoton 
Falguni and Pawan had not yet joined the gang. 



Now one year later 


(Scenes from Season III) 


... They are still promising "final" 
delivery of Collection 6 algorithms 

(imagine camera pans into each office) 


Rob is answering 40 pages of AMTD comments 

Leigh is fixing the coastline mask 

Shana is insisting that Version V6.0.27 
the final version 

Rich is re-evaluating DeepBlue/DarkTarget merge 

Lorraine comes to GSFC because she misses the 
rest of the gang. 

Falguni is fussing with gas correction. 

Pawan is improving urban aerosol retrieval 
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Introducing the Collection 
6 MODIS aerosol products 

Subtitle: The art of the MODIS 
aerosol retrieval 


Sub-subtitle: Getting a cat into a carrier 


Trying to get C6 into product is like... 



Video found on You-Tube 
Note: no harm to cat 
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Aerosol retrieval from MODIS 


What MQDIS observes Attributed to aerosol (AOD) 



There are many different "algorithms" to retrieve aerosol from MODIS 

1. Dark Target ("DT" ocean and land; Levy, Mattoo, Munchak, Remer, Tanre, Kaufman) 

2. Deep Blue ("DB" desert and beyond; Hsu, Bettenhousen, Sayer,.. ) 

3. MAIAC (coupled with land surface everywhere; Lyapustin, Wang, Korkin,...) 

4. Ocean color/atmospheric correction (McClain, Ahmad, ...) 

5. Etc (neural net, model assimilation, statistical, ... ) 
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6. Your own algorithm (many groups around the world) 




Generic MODIS-DT retrieval algorithm 


INPUTS / UPSTREAM PRODUCTS 

• MOD02 = MODIS spectral reflectance pixels (at 500 m resolution) 

• MOD03 = geo-location: geometry and surface type ( 1 km resolution) 

• MOD35 = cloud mask, including IR tests. Also has surface type 

• Ancillary data: GDAS 1° ozone, water vapor, surface wind speed 


Aggregate into 
N x N boxes 


= 20x20 for 1 0 km 


1 00% water? 


{ 

Try Ocean retrieval 



Coastal?^ lakeshore? 
No retrieval 


At least 1 % land? 

* 

Try land retrieval 


“Massaging” input data 

Cloud masking (MOD35 IR tests + our tests) 

• Perform spectral gas absorption correction 

• Other masking (glint, deserts, sediments, etc) 

• Sort and select valid pixels -> one value per N x N 

* 

The retrieval itself 

Compare with pre-computed Lookup tables (LUTs) 
Decisions about what is a “successful” retrieval 
Decisions about what to report, and under what conditions 


We expected to 
change these for 
C6 




Last November we submitted 
Collection 6 overview paper to AMTD 


Levy, R., S. Mattoo, L.A. Munchak, L.A. Remer, A.M. Saver, and JNL 
Hsu (2013). The Collection 6 MODIS Aerosol Products over Land 
and Ocean Atmos. Meas. Tech. Disc. (6), 159-259 

• We thought it would be a service to our users to have 
paper out when C6 processing began. 

• It was a really long paper (100 AMTD pages) describing 
major updates and effects on the "products" 

• It received 40 pages of online criticism and comments 

• Then the rug was pulled out from under us. 


What happened? 


11 


The world changed 

(or at least the MODIS-observed view of the world) 

INPUTS / UPSTREAM PRODUCTS 

• MOD02 = MODIS spectral reflectance pixels (at 500 m resolution) 

• MOD03 = geo-location: geometry and surface type ( 1 km resolution) 

• MOD35 = cloud mask, including IR tests. Also has surface type 

• Ancillary data: GDAS 1° ozone, water vapor, surface wind speed 



• For MOD02: Different decisions about bad/missing pixels, plus calibration 

• For MOD03: Definitions of land/water/coastal were changed 

• For MOD35: IR test finding high cirrus clouds was changed 

• For ozone: Input stream changed from TOAST to GDAS 

"Our" changes for C6 needed to be revised 

Note: that "our" also refers to ALL MODIS products (clouds, land surface, etc) n 




"Definitions" of land/coastal/water: 

C5: Used MOD35; C6: Use MOD03 (It's a long story) 


MODIS AOD, with no coastline pixels 

This is ARCTAS 
region in 
northern 
Canada. 

Land 'o lakes 


Note very little 
"coastal" in C5. 

Clean divide 
between Green 
(land) and 
Yellow (Lakes) 


1 2 3 4 5 6 7 8 


C5 MOD03 Land/Sea Mask 




MODIS AOD, with coastline pixels 


improved 
coverage near 
water 

/ 


550 nm AOD 

0.00 0.25 0.50 0.75 1.00 1.25 1.50 



C6 MOD03 Land/Sea Mask 



1 2 3 4 5 6 7 8 


Note much 
more "coastal" 
in C6. 

Lots of 

shorelines (lime 
colored) pixels 
that would be 
thrown out. 





... Now they are promising "final" 


delivery of Collection 6 algorithms 


(Shana will allow NO MORE CHANGES!!!!) 

OUTLINE of REST of TALK 


COMING 

SOON 


• Compensated for upstream changes! ! ! ! ! 

• Better RT (gas corrections, LUTs) 


• Cloud mask and pixel decision-making 

• "Science" upgrades 

• "Quality assurance" upgrades 

• DT products (expected C6 versus C5) 

• Other stuff: 3 km, DT/DB merge, etc 
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Better RT: Gas Corrections 


• Gases (H 2 0, 0 3 , C0 2 , N0 2 , etc... ) absorb radiation, T < 1.0 

• T varies spectrally and function of gas optical depth: 

• T = l-T • 

'gas u gas* 


• The C5 assumptions were undocumented (circa 1995) 

• Used modern RT code and found changes 

• Changes for C6 have mpacts. 
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Gas Corrections (cont.) 

Gas Optical Depths for Mid Latitude Summer 
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Version, MODIS Band 

Consistent "bias" of Ap* ~ 0.001 -> "bias" of AOD of 0.01. 

Bias is double for Z=60°. Quadruple for two-way transmission ! 

Something really weird is happening at 1.24 pm channel (big impact on land retrieval) 
ACE: We want to know global AOD to ±0.01? Not when we don't know gas! ! ! 
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Radiative Transfer updates (applied to C5) 




Jul 2008: Aqua 

C5 V6Gas 




AOD Difference 

- 0.12 - 0.08 - 0.04 0.00 0.04 0.08 0.12 


AOD at 550 nm 

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 


Recalculate "center 
wavelengths" from 
MODIS filter functions, 
and spectral Rayleigh 
optical depths 

Recalculate gas 
absorption coefficients 
and optical depths for 

H2O, O3, CO2, CH4, O2, 

etc 

Extend valid solar 
zenith angle from 72° 
to 84°. 

Pretty big changes, but 
they are justified. 
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Update cloud masking (ocean & land) 


MYD04 L2.A20 1 0227.1 705.hd1 


Without cloudmask 




With new cloudmask New Pixels 



AOD at 550 nm 


-0.05 0.15 


0.55 0.75 


Retrieve more 
"heavy smoke" 
cases 

Retrieve fewer 
"thin cirrus" cases 

Correct 

assignment of QAC 
due to clouds 


0.35 
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Science: wind speed dependence (ocean) 



NCEP winds - 6 m/s winds 


-12 



AOD Difference 


- 0.03 - 0.02 - 0.01 0.00 0.01 0.02 0.03 



- 0.03 - 0.02 - 0.01 0.00 0.01 0.02 0.03 - 0.12 - 0.08 - 0.04 0.00 0.04 0.08 0.12 


• Higher wind speeds 
-> more ocean foam 
and diffused glitter 
pattern 

• Aerosol LUT now 
calculated for 4 wind 
speeds 

(v=2, 6*, 10, 14 m/s) 


• Retrieved AOD 
reduced when v>6 


• Reduces AOD near 
40° glint mask edges 
and in "Roaring 40s" 
of southern Oceans. 
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Pixel Counts 


Quality Confidence "definitions" 


AOD Histogram over Ocean 



Ot-c^uOOuOOuOOOOOOOOOO 

OOOO^^CVJCVJcOrfUONOuOOOO 

dddddddddddo^^csicouo 

AOD at 0.55 


Old (C5): Quality 
assurance depends on 
success of a retrieval 
solution. If aerosol signal 
is too small, then do not 
include in daily/monthly 
statistics. 

New (C6) : Sometimes 
signal is small, but we are 
confident that it is small. 
Include in daily/monthly 
statistics. 


- But "major" influence on estimating regional and global mean AOD 
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Surface Reflectance (0.644 urn) 


Major bug fix: surface reflectance relationship to 

NDVI swir 


Jul 2008 


C5 NDVI 


0.644 urn VS 2.12 pm Surface Reflectance 
as a function of NDVI bins 

SWIR 


0.25 


0.2 


0.15 


0.1 


0.05 


<|<=^ND\/I >0.75 

SWIR 


■025 <ND VI 9 ^ 0.75 


NDVI <0.25 

SWIR 


Regression 
-y = 0.000 + 0.554X R= 0.891 
- y = 0.007 + 0.460x R= 0.898 
-y = 0.002 + 0.470X R= 0.915 


V I 
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K 
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Forced through Zero 

y = 0.558x 
y = 0.51 7x 


y = 0.491x 


0.05 0.1 0.15 0.2 0.25 0.3 

Surface Reflectance (2.12 um) 


0.35 


< 




These labels were reversed 
Resulting in coding error 




AOD Difference 


-0.12 -0.08 -0.04 0.00 0.04 0.08 0.12 


Coding error from 
C5 continued to C6 

Surface 
reflectance 
dependence on 
NDVI_swir was 
reversed 


New: Reduces 
super-high bias for 
semi-arid regions. 
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New INPUTS 


New GAS and LUT 



- 0.12 - 0.08 - 0.04 0.00 0.04 0.08 0.12 

C6 
on 



Fix cirrus bug over land 


Add wind speed dep. 


0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 



Results from ALL changes 



Jul 2008: Aqua 


Version 6.0.27 



NDVI switch 


Mostly wind 

speed 

upgrades 


AOD Difference 


- 0.12 - 0.08 - 0.04 0.00 0.04 0.08 0.12 



Higher zenith 
angle valid 


AOD at 550 nm 


Coverage 


Decisions about 
land/sea/coastal 


0.0 0.1 0.2 0.3 0.4 0.5 0-6 0.7 0.8 


- lower AOD over ocean, but significantly lower over southern oceans 

- Higher AOD over most land, but lower in semi-arid regions. 

- Changes in decisions to retrieve (see Aral sea). 
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MODIS 553 nm AOD 


Preliminary "validation" of C6 
6 months testing (on Aqua) 


Land 


1.2 


C0t)5 Statistics 
% within EE = 70.01 
% above EE = 15.12 
_% below EE = 14.87 
N = 2461 ; R = 0.86 
Y = 0.96+ 0.00 


Cbb6 Statistic^ 

% within EE/= 70.7< 
% above EE = 

. % below EE-= 

* N = 2839; R; 
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C006 Statistic^ / 
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1.2 


• No dramatic changes, but 10-20% more valid collocations with AERONET 

• C6 algorithm has slightly better (68% vs 64%) retrieved over ocean 

• C6 will have more of a high bias over land, but slightly better correlation. 24 


Aerosol Optical Depth at 550 nm 


C5: Trends Terra * Aqua 


MODIS AOD Monthly Mean - Land Only 


Terra: y = -0.003x + 0.204, R 2 = 0.128 
Terra*: y = -0.005x + 0.219, R 2 = 0.191 

} 2 = 0.001 



0.13 




& & & & & $ 
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• Over land, Terra decreases (-0.04/decade), Aqua constant 

• Terra / Aqua divergence is the same everywhere on the globe! 

• Artificial Terra trend traced to degrading of Terra's calibration 
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C6: Impact of New Terra calibration 


Jul 2008: Terra 



0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 - 0.12 - 0.08 - 0.04 0.00 0.04 0.08 0.12 


• Main impacts over land 

- Global increase by 0.02 (for this particular month) 

• Impact over ocean is small 

- Global increase by 0.004 (for this particular month) 


Jack Xiong, 
Junqing Sun and 
MCST 
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C6: Impact of new calibration on trend? 


LAND 



• 6 months processed with same dark-target aerosol algorithms 

• Terra (T) now "in sync" with Aqua (A) time series 

• (Terra-Aqua) offset remains 0.01 (ocean) and 0.015 (land) 

• New calibration Terra/Aqua divergence removed for C006! 
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What else for C6 Level 2? 


28 



New Diagnostic SDSs 


Land_Ocean_Quality_Flag 

32 : 



0: Poor 1: Marginal 2: Good 3; Very Good 


TopographicAltitudeLand 
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Surface Height [km] 


0 12 3 



Land_Sea_Flag 



Ocean Land 


Wind_Speed_Ncep_Ocean 

: r I J...3 !iJ : 

' ’ ' * " , L - - * - ’ ' 
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Wind Speed [m/s] 

20 1 

012345678 




Cloud and Aerosol SDSs 


Aerosol_Cldmask_Land_Ocean 
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Clear Cloudy 

500 meter resolution cloud mask used 
in aerosol retrieval. Can be (at times, 
significantly) different than MOD35 


Distance to Cloud 
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Distance to Cloud [pixels] 


0 4 8 12 16 20 


Number of pixels between an aerosol 
retrieval and the closest cloud. Not 
thoroughly validated yet. 
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Jan 21 2010 at 13:40 UTC 



The Deep/Dark merge 


• Dark, bright, and transitional regions are 
identified by monthly mean NDVI 

• In Dark regions, value from dark-target 
retrieval is used 

• In bright regions, deep-blue is used 

• In transition regions, AOD is merged, 
dependent on QA of retrievals 


DeepDark Algorithm Flag 



0: Dark Target 1 : Deep Blue 2: Mixed 


C. Hsu, A. Sayer, C. Bettenhousen, S. 
Mattoo, L. Munchak, R. Kleidman, et al., 



DeepDark 550 nm AOD 


AOD at 550 nm 

^ ’ ' ' 

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 



Monthly mean AOD for Aqua, January 2010 



Dark Target AOD 


DeepDark AOD 


AOD at 550 nm 

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 


AOD at 550 nm 

1 -=- : : 

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 


Merging deep blue & dark target produces best global coverage 

* Deep blue is land-only; need dark target for oceans 

* Deep blue introduces coverage over Australian outback, Sahara desert 

and Arabian peninsula 

* Still no coverage over snow (see: most of Northern Hemisphere). 

MERGE LOOKS REASONABLE, BUT NOT VALIDATED YET!!!! (Kleidman et ai) 




What about C6 Level 3? 
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Calculating mean AOD 
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• It depends on the post-processing path 

• Many choices for aggregation and weighting 

• Accentuate different limitations of original (L2) sampling 




Changes to Level 3: monthly 


C5 


C6 


C6-C5 



equal c^y weighted-pixel weighted 



AOD at 550 nm 



0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 


AOD Difference 



- 0.06 - 0.04 - 0.02 0.00 0.02 0.04 0.06 


• Pixel weighting for monthly data is removed 

• Replaced by "equal day" weighting (assuming at least 5 observations 
per day). 

• -> Increase monthly mean AOD over land, and ocean 35 


Global -> Local 


Nominal resolution (e.g. 10 km) cannot 
resolve higher scale (e.g. urban, 
neighborhood) variability 

Air Quality community has been asking (no 
pleading!) for higher resolution data 

We have been afraid to lose the advantage 
(pixel statistics) of the 10 km. 



3 km algorithm 

In two AMT-Discussion Papers (in revision for AMT) 


• Munchak, L„ R.C. Levy, S. Mattoo, L.A. Remer, B.N. Holben, J.S. Schafer, 
C.A. Hostetler, and R.A. Ferrare (2013). MODIS 3km Aerosol Product: 
applications over land in an urban/suburban region, Atmos. Chem. Phys. 
Pis, 6, 1683-1716 
doi:10.5194/amtd-6-1683-2013 


• Remer, L., S. Mattoo, R.C. Levy, and L. Munchak (2013). MODIS 3km 
Aerosol Product: Algorithm and Global Perspective, Atmos. Meas. Tech. 
Disc., (6), 69-112 
doi:10.5194/amtd-6-69-2013 


• J. M. Livingston, J. Redemann, Y. Shinozuka, R. Johnson, P. B. Russell, Q. 
Zhang, S. Mattoo, L. Remer, R. Levy, L. Munchak, and S. Ramachandran, 
(2013). Comparison of MODIS 3-km and 10-km resolution aerosol optical 
depth retrievals over land with airborne Sunphotometer measurements 
during ARCTAS summer 2008, Atmos. Chem. Phys. Pis, (submitted last 
week). 
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MODIS 3 km product over suburban (MD) landscape 

(summer 2010) 
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MODIS vs DRAGON 
July 21, 2011 

AOD (AERONET: DRAGON) 


( N 38.7950, U 77.4000 ) 


( N 38.7950, M 75.7500 ) 


DRAGON = Many AERONET over Maryland 
during DISCOVER-AQ experiment, July 2011 
For MODIS plots, QA=3 only 

• Circle Center = AERONET ±2 hours 

• Circle Outer = MODIS 5 x 5 box 
3km (bottom) resolves Baltimore maxima 
Gray is MODIS-Aerosol cloud mask 

3km also resolves aerosol over Ches. Bay 


MYD04 10km 550 um 2011202 18:30 
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L. Munchak 





AOD at 550 nm 


- 0.05 0.05 0.15 0.25 0.35 0.45 0.55 0.65 0.75 


MODIS 3 km product (operational for C006) 


Algorithm structurally identical to standard "10 km" retrieval 
Results will be in new files, 'MOD04_3K' 

Over land and ocean, (but no Deep Blue yet). 

Both MOD04 L2 and MOD04 3K will be available 


S. Mattoo, L. Munchak, M. Martins, L. Remer, B. Holben,4tet al 


Summary (1) 

• Dark-target algorithm/products are updated for 
C6, but only "modest" changes (no major science 
updates). 

• "Modest" is relative... Many difficult decisions 
about seemingly small things that actually were 
significant, (e.g. Gas Correction, Cloud Mask, 
Quality Assurance etc). 

• Upstream changes (LIB and MOD35) meant we 
had to re-analyze, over and over. 

• Not superhero like, but there were mistakes 
(bugs carried over from C5) that needed re- 
analysis. 

• Dark-target and Deep-blue products are merged, 
leading to more global coverage 
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Summary (2) 


• MODIS aerosol retrieval was intended for 
global climate applications 

- Air quality events are sometimes on urban and 
local scales 

- Aerosol properties change near clouds 

- -> The MODIS dark-target team is offering 3 km 
operational aerosol data. 

- Issues in land/sea/coastal are ACCENTUATED! 
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Trying to get C6 into product is like. 



Hopefully, there will be no season IV for "Introducing Collection 6 products" 



On towards Collection 7! 



Proper per-pixel 
error products 

Better urban 
retrievals 

Use IR information 
for dust detection 

Etc: It's proposal 
season! 


THANK YOU FOR YOUR ATTENTION !!! 



